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ABSTRACT 

The aost coaaonly stated and denonscratcd 
shortcoaing of the eaployaent interview is its lack of reliability. 
Yet Wagner (1949) was able to conclude that the reliability of an 
eaployaent interview is situation and interviewer specific. In this 
study, the author investigated the interviewees scoring system, the 
way he weighs and coabines the inforaation he gathers as he atteapts 
to aake a personnel decision. This inforaation processing includes: 

(1) assessing the interrelations of the cues; (2) assessing the 
validity of the cues for his given purpose; and (3) coabining the 
individual validities while partialling out the coaaon variance among 
the cues. Results show that: (1) interviewers aake adjustaents when 
they perceive redundant inforaation; (2) they process negative 
inforaation aore accurately than positive inforuation; and (3) they 
differ widely in teras of how valid and interdependent they perceive 
inforaation units to be. The decisions or hiring recommendations were 
based alaost exclusively on tho overall evaluations of the 
inforaation which the interviewers received and processed. If the 
final evaluation exceeded the base rate of success, the 
recoaaendation was to hire; if not, the recoaaendation was to reject. 
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A Preliminary Look it Employment Interviewers' 

Proficiency at Combining Information Cues 

Thomas 0. liollmerji 
Wayr.e State University 

Salvation for the employment Interview Is unlikely unless It can be 
shown that Interviewers' judgments are other than random. Ultimately, 
we would like to 3ee a high degree of agreement among interviewers on 
valid predictions of job success. But to achieve this desirable state 
of affairs It Is first necessary to gain a better understanding cf the 
basic element Involved, the Individual employment Interviewer. 

The most commonly stated and demonstrated shortcoming of the 
enployment interview Is Its lack of reliability. Interviewers, we 
..re told, seldom agree on their rankings or ratings of applicants 
(Scott, 1915). Aid yet there Is hope. Intrarater reliability Is not 
so bad (Shaw, 1952; Anderson, 195*0 and fur hermore, Bass (1951) has 
shown that tnterrater reliability among Interviewers In the same company 
Is sultcbly high (r**.56 and .74) when they follow the samo patterned 
Interview guide, even though the patterned procedure did not Increase 
the usual low agreement among Interviewers In different companies. 

This evidence substantiates Wagner's (1949) conclusion that the 
reliability of the employment Interview Is situation and Interviewer 
specific. And why shouldn't It bet? We do not necessarily expect 
high agreement emong all similarly named scales across ail personality 
Inventories, only test-retest egre^sent within each specific Inventory. 
If each Interviewer has his own way of gathering end Interpreting 
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Information based on his own experience and the particular requirements 
of his specific job situation It would be a good Idea to spend some time 
looking at the operations of Individual Interviewers before combining 
data across Interviewers to look at the overall effect lvene$3 of the 
employment Interview, 

I chose to begin by Investigating the Interviewees scoring system 
--the way he weights and combi nes the Information he gathers as he 
press i$ towards a personnel decision. 

Given that the employment Interviewer attends to the Information 
which !>e gathers, this Information processing required of tne Employment 
interviewer Includes three steps* First, he must assess the validity 
of the cues for his particular purpose. Second, he must assess the 
Interrelations of the cues, and third, he must combine the Individual 
validities while partlalllng out the common variance among the cues. 

The subjects In this study were 39 Employment Interviewers, all 
of whom had experience Interviewing applicants for management trainee 
positions, ti>e -job 1 the Interviewers were to consider. 

Date was collected In 3 stages corresponding to the three Infor- 
mation processing steps (although In a different order). The first 
stage was designed to obtain each Interviewer's belief as to the 
Independent validity of all Information cues to be used In the study* 

This was dona by having each J> estimate the base rate of success for 
management trainees In hU organization and then evaluate 43 hypothetical 
applicants, each one being described by one Information unit* The rating 
was made as e probability of success* The P($) minus the &&($), another 
probability estimate, wa i the Index of validity, the sign Indicating 
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v; aw her the Information was perceived as being favorable or unfavorable. 

The second stage was the Information processing task. $s were 
presented with 3 applicants, each represented by 15 of the previously 
evaluated Information units. The units were presented one at a time, 

In a pre-arranged sequence: following each unit the S made a reevaluation 
of the applicants P($). After the final reevaluation, the S also made 
a decision to hire or reject the applicant. 

The third stage of data collection tapped the Ss* perception of 
the overlap among the Information cues. The three sets of 15 Information 
cues were prtiented again, In tho same order as In the applicants. This 
time, on encountering each successive Information unit, Ss shaded In a 
portion of a rectangle to represent the proportion of new Information 
that overlapped with the information already obtained. 

data frcm stages I and 3 were used to obtain predicted re- 
eve lua: Ions, the criterion against which performance on the Information 
processing task wes evaluated. The Initial Independent values of the 
Information units, the shifts from the base rate of success, were reduced 
by a factor corresponding to the percent overlap to obtain predicted 
shifts. This strategy, obviously, assumes a linear, additive model 
of combining Information, in all computet ions, percent values were 
first converted to standard units from the normal distributor to a? low 
comparisons at various points on the percentile scale. 

Errors In reevaluations, Actual Shift minus Predlctad Shift, were 
then computed for each of the 15 reevaluations of each applicant by 
each Interviewer. Overshifts, actual shifts greater than the predicted 
shifts, received a positive sign; undershifts, actual shifts less than the 
predicted shifts, received a negative sign. Errors were not cumulated In this 
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procedure; actual shifts for each Information unit were calculated 
from the previous evaluation, regardloss of any errors that had 
occured up to that point. These Individual shift error scores were 
used to obtain, for each Interviewer, an average error score for fevor- 
able units of Information and an average error score for unfavorable 
units of Information. 

The Interviewers' over.il I performance can be most easily appreciated 
by comparing their actual reevaluations with <be cumulative predicted 
reevaluations (Fig. I). The cumulative predictions represent the course 
which the Interviewers' reevaluations should have followed If they were 
operating perfectly In relation to the linear, additive model. In most 
cases it was clear that the form of the actual > > eeveluatlons was similar 
to that of the predicted reevaluations. Moreover, the graphs indicate 
that while an Interviewer may be "thrown off the track" by one unit of 
Information, the chance of the same Interviewer correctly processing any 
one additional unit of Information remains high. This can bn observed 
In Figures 2 end 3. 

To fully appreciate the genorel accuracy of the Information 
processing performed by many of the Interviewers, two characteristics 
of this graphic presentation must be kept In mind: (l) the errors do 

cumulate h^r*., end (2) equal percentile differences ere not equivalent 
throughout the range of the scale. Therefore, It Is the similarity 
In form of tha actual and cumulatlva predicted reevo’uet Ions end not, 
necessarily, lhair congruency that Is Indicative of "gootf' Information 
processing. For thasa reasons, tha bulk of tha analyses made use of 
the error scores described e fsw moments ago. 
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Hot all Ss performed as well as the first few examples. The 
majority, 24, did: the rest could be divided Into two general categories. 

Nine Interviewers had predicted evaluation curves that went rapidly to 
an asymptote at 99,99% chance of success while their actual reevaluations 
were of a fom similar to those of the "good" processers (Figure 4). 

These Interviewers were evidently making sizable shifts on the basis 
of Individual Information units but were being more conservative when 
more Information was expected. The remaining six Ss showed no relation- 
ship oetween their predicted und actual reevaluat Ions (Figure 5)* In 
soma cases the performance Is simply not congruent with the model; In 
a few cases the Ss apparently, In the Information processing task, were 
attempting to replicate their performance on the Independent rating task, 

An rnalysls of favorable and unfavorable Information erior scores 
Indicates that Intervlewors are more accurate, relative to this model 
and design, In the processing of negative Information than In the 
processing of positive or favorable Information, the errors on positive 
Inforuatlon being consistently of a conservative nature, l.e., under- 
*hlfts. In all cases the errors on favorable Information were signifi- 
cantly less than zero; In no case vas the error on unfavorable Information 
slgnlf leant ty different from zero. 

These results do not agree with previous findings. Bolster and 
Sprlngbatt (1961), for example, found that, per unit of importance, 
Interviewers gave more weight to negative Information* However, they 
used non -comparable scales to obtain Independent ratings of Information 
units and the sequential ratings* Thus, the best they could do was 
demonstrate e more-or-less relationship. Using comparable scales, this 
study finds that, per unit of Importance, Interviewers give less weight 
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to positive information and process negative information accurately. 

The decisions or hiring recommendations were based almost exclusively 
on the overall evaluations of the Information which the Interviewers 
received and processed, if the final evaluation exceeded the base rate 
of success the recommendation was to Hire: If below the base rate the 

recommend* t ion was reject. 

This does not Imply that the decisions were valid! The information 
practising was accurate only with respect to the linear additive model 
and the Interviewers' own beliefs as to the validity of the Information 
cues. It 1$ possible, for instrice, that Interviewers overestimate the 
strength of negative validities for Independent Information units and 
thus do, In fact, give It too much weight In ?.h& final analysis. But 
given their beliefs, the Information processing by employment Inter- 
viewers Is often very accurate. 
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Sequence of Information Uni 
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Sequence of Information Units 
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FIGURE 3 
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Sequence of Information Units 
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Sequence of Information Units 



Sequence of Information Units 
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Probability of Success in Percents 
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